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■^■. Jarzynski Relations for Quantum Systems and Some 

O : Applications 

■ Hal TasakiQ 
D ■ 

in 1 Introduction 

(n: 

^ In a series of papers (see [l|, |], ^ and references therein) Jarzynski proved remarkable 

i-C ' exact relations in various dynamical systems which relate nonequilibrium quantities with 

(\j • equilibrium free energies. Possible relations between Jarzynski's results and the "fluctua- 

^ ! tion theorem" for steady state nonequilibrium systems has been pointed out by Crooks 0. 

Piechocinska [Q and Kurchan extended some of these results to quantum systems. See 

also [0] for a related (but different) attempt at extending Jarzynski relations to quantum 

systems. 

c^ ■ In this note, we derive quantum analogues of Jarzynski's relations, and discuss two 

Vh ' applications, namely, a derivation of the law of entropy increase for general compound 

'-^ I systems, and a preliminary analysis of heat transfer between two quantum systems at 

C I different temperatures. We believe that the derivation of the law of entropy increase in 

Q ' Section ^ is new and rather important. (But the argument is essentially that in [§.) 

'""'■ It is likely that many of the materials presented here are known to experts in the 

CN . field. We nevertheless believe that to summarize all these results in a self-contained (and, 

^ i hopefully, transparent) manner can be useful for further investigation in related (more 

t:^ I difficult) problems. 

^ ' We have tried to make the present note technically self-contained. The readers are 

(3 ■ suggested to go back to the references for physical backgrounds. 

o: 

O. 

t^ ' 2 Jarzynski relations for quantum systems 

I ' We concentrate here on a general quantum mechanical system with a single time-dependent 

r^ • Hamiltonian, and describe the derivation of quantum analogues of Jarzynski relations. 

O ■ Some of the results are already derived in [|, |] . 



X 



2.1 Setup 



j^ ■ Let us give abstract settings without specifying physical interpretations. 

Consider a quantum system with an A^-dimensional Hilbert space. Take an arbitrary 
time-dependent Hamiltonian H{t) in the time interval t G [tinit , ^fin] , and let iif(tinit) = H 
and i/(tfin) = H'. For i = 1, . . . ,N, we denote by \(pi) and |(/9^) the normalized eigenstates 
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of H and H', respectively, with eigenvalues Ei and E'^. Let U be the unitary operator for 
time evolution during the whole period^. 

We assume that, at t = tinit, the system is in the Gibbs state with inverse temperature 
/?, which is described by the density matrix 

Pinit - ^^, (2.1) 

with Z{(3) = Eili e-f^^'. We denote by 

(■••)i„it = Tr[(-->init], (2.2) 

the expectation at f = finit, and by 

(■■■)fin = Tr[(---)t/pi„itf/-'], (2.3) 

the expectation at t = tfin. 

Let us define a crucial quantity 

P-I3E, 
P^,J = -ZJJJ^m\U\^^)\^ (2.4) 

which (if one wishes) can be interpreted as the probability that one finds the system in the 
i-th eigenstate of if at t = tinit and then in the j-th eigenstate of H' at t = tgn. (See [|, 
and footnote 1^.) One can also think oi Pij as a purely theoretical quantity without giving 
it any interpretations. Note that the unitarity (and the definition of Z{f3)) guarantees the 
normalization J2i,jPi,j = 1- For any function f{E, E') of two energy variables E and £", 
we define its "classical average" by 

N 

f{E,E')= J2p,,f{E,,E;). (2.5) 

It is crucial to note that, in a general situation where H and U^^H'U do not commute, 
the classical average f{E, E') does not correspond to quantum mechanical expectation in 
any obvious way. However, for the simplest /, we easily find 

^=(^)init, ^=(^V, (2.6) 

which will be crucial for the applications of the main equality. 

2.2 Jarzyinski's equality and inequality 

From the definitions ( |2.5| ) and ( |2.4| ), we find for any /5 that 



1 N 



Z'0) 

. zm ' 



(2.7) 



^ Let U{t) be the solution of the Schrodinger equation idU{t)/dt = H{t)U{t) with [/(iinit) = 1- Then 

U = [/(tfin). 



where we used the unitarity to get the second hne, and introduced Z'{/3) = J2jLi^ ^■ 
We call (p^) the Jarzynski equality. 



By using the Jensen inequality exp(/) > exp(/), we find that 

^^P{PE-P-W)<^- (2.8) 

By noting the identities ( |2.6| ), this reduces to the following inequality for quantum me- 
chanical expectation values. 

P (H),^,^ - /3 {H'),^ < \ogZ'0) - logZ(/?), (2.9) 

for any /?. 

Remark: (9/25/2000) The inequality (|2.9|) (as well as other inequalities such as (|3.16|) and 



(19)) follows directly from the wellknown property of the relative entropy as follows. (We 
stress, however, that the Jarzynski's basic equality contains much stronger information 
than the corresponding inequality.) 

Let pinit be an arbitrary density matrix and let pfin = UpiaitU^^ where U is an arbitrary 
unitary operator. Then we have 

Tr[pinitl0gpinit] = Tr[pfinlogPfin], (2.10) 

which is the well known invariance of the von Neuman entropy. Let p' be an arbitrary 
density matrix. Then the relative entropy satisfies 

^(p'lpfin) = Tr[pfin(logpfin - logp')] > 0. (2.11) 

By combining ( |2.10| ) and ( p.ll| ), we get 



Tr[pinit logpinit] > Tr[pfin logp']. (2.12) 

This inequality reduces, for example, to ( p.l6|) by choosing both the initial density matrix 
Pinit and the reference density matrix p' as Gibbs states. 

2.3 Basic applications to thermodynamics 

We now suppose that our quantum mechanical system is a macroscopic one, and imagine 
that the time dependent Hamiltonian H{t) models an adiabatic operation in thermody- 
namics. (See, for example, [|T2|.) We further suppose that the Hamiltonian H{t) stays 
at H' sufficiently long time at the end of the operation, so that the system reaches a 
macroscopic equilibrium. 

By first setting (3 = P, we get an inequality for the (expectation value of the) work 
W{U) done by the outside agent (who controls the Hamiltonian) to the system, i.e, 

W{U) ^ (//%„ - (H),^,, > ^{log Z{f3) - logZ'iP)}. (2.13) 



Since the relation of (the classical version of) this inequality to the minimum work principle 
is fully discussed in |]l|, we do not repeat the discussion here. 

Now in a thermodynamic system whose energy is known to be U, its entropy can be 
obtained via a Legendre transformation a^ 

SiU) = minPiU - F{P)} = P{U - F{J3)}, (2.14) 

where F[(3) is the Helmoholtz free energy, and P is the unique inverse temperature at 
which the minimum is attained (and which is nothing but the equilibrium value of the 
inverse temperature). 

From the basic inequality (^.9[), we have 



/5{(^)i„it - nm < P{{H%^ - F'm (2.15) 

for any (3, where F{(3) = -f]-^ log Z{P), and F'(/3) = -f]-^ log Z'0). From (gJ^), we see 



that the left-hand side of (|2.15|) is nothing but the entropy S of the initial state, and the 
minimum over f3 of the right-hand side is the entropy S' of the final state. Consequently 
we find from ( |2.15 ) that 

S < S', (2.16) 

which is the law of entropy increase in an adiabatic process^. 

2.4 "Fluctuation theorem" like symmetry 

The reader interested in the topic of Section ^ can skip the present subsection. 
Let a variable w take values of the form E'^ — Ei for z, j = 1, . . . , A^, and let 



N 


-E,-- 


= 'w] PiJ 


N 


-E,-- 





m\U\v^)\^ (2.17) 

where the characteristic function is defined as x[true] = 1, and x^rue] = 0. This can be 
interpreted as the probability that the difference of the measured energies^ at the initial 
and the final states is equal to w. 

Now an easy calculation shows that 






|||,[£.-E;^-H|:p;i(..|t/-V;)p. (2.18) 



^ Throughout the present note, we set the Boltzniann constant to unity. 
The inequahty (p. 15) is vahd f or arb itrary finite systems. But (2.16) is meaningful only for macro- 
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scopic systems, since the definition ( p.l4|) of entropy should be used in the thermodynamic limit. 

^ We suppose that, as in [gj, ^, one first measures H at time t — tinit, and the state contracts to the 
eigenstate which corresponds to the measured energy. Then the system evolves according to C/, and one 
measures H' at time t = tfin. 



With ( p.lTp in mind, it is natural to define 



N p-l3E' 

Pu-A^') = E X[E, -E[ = w'] ^^ |(^,|t/-V:)r- (2.19) 

This correspond to the inverse situation where the initial state is the Gibbs state for H' , 
and the time evolution is given by U^^ . Then (p.l8| ) implies 

e-^-Pu{w) = ^Pu-^{-w). (2.20) 

Consider a situation where H = H', and the time evolution is symmetric in the sense 
that]] 

\{cp^\U\^,)\ = \{cp^\U-'\^,)\. (2.21) 



Then we have Z{P) = Z'{(3)^ and Pu{w) = Pu-^i'^)- Thus ( p.20|) take the significant form 



e-'^'^Puiw) = Pu{-w), (2.22) 

which (at least formally) resembles the fluctuation theorem for steady stateQ. But it is 
questionable whether this equality carries information about nonequilibrium systems (like 
the original fluctuation theorem). Later in Section ^, we derive another relation which 
also resembles the fluctuation theorem. (See ( |4.15| ).) We do not go into details about 



the fluctuation theorem, and just refer to recent works [^ |T0|, and those discuss possible 
relations between the fluctuation theorem and the Jarzynski relations [^, ^. 

3 The law of entropy increase for general compound 
systems 

3.1 Precise statement in thermodynamics 

The law of entropy increase represents the heart of the second law of thermodynamics. In 
the present note, we have already discussed the law of entropy increase ( |2.16| ), but this is 
only for simple systems. 

A simple system is a basic notion in thermodynamics, which stands for a system that 
can exchange energy within it, and hence always attains a uniform temperature in equilib- 
rium. A com,pound system,, on the other hand, consists of several distinct simple systems 
which do not exchange energies with each other. (In the usual language of thermodynam- 
ics, they are separated by "adiabatic walls.") An equilibrium state of a compound system 
is a composition of equilibrium states of each simple system that constitute it. 

We assume that a thermodynamic (i.e., macroscopic) equilibrium state of simple system 
is completely characterized by specifying its inverse temperature /? and a set X of extensive 



^ This is true when H{t) is symmetric in the sense that H{t) = if (tmit + ifin — t) for any t such that 
iinit '^t < tfin, and the matrix elements {ipi\H(t)\ipj) is real for all t and i,j. 

^ One finds that the derivation is quite similar (although the derivation of the present result is rather 
trivial). See especially [p|. 



variables^]. In case of a fluid with M components in a container, X = {V, Ni, . . . , Nm) 
where V is the volume of the container and Ni the amount of i-th substance. We denote 
by (/?; X) the equilibrium states specified by (3 and X. 

Then an equilibrium state of a compound system can be written as 

{(A;Xi)|(/52;X2)|---|(/3„;X„)}, (3.1) 

where {[3k] Xk) denotes the equilibrium state of the A;-th simple system constituting the 
whole compound system. Here the vertical bars represent adiabatic walls. 

Then the strongest form of the law of entropy increase states that if an adiabatic 
operation 

{(A; X,)\ . . . !(/?„; X„)} -. {{P[- X[)\ . . . \{P'^- XJ}, (3.2) 

is possible, then one always has[| 

n m 

Y.S{(3u:Xk)<Y.S{P',;X[), (3.3) 

A;=l ^=1 

where S{j3\ X) is the entropy of a simple system in state (/3; X). Note that we allowed the 
number of simple systems to vary in the adiabatic operation ( p.2| ), since we can insert or 
remove adiabatic walls during an operation. 

We stress that the law of entropy increase for compound system is much stronger 
than that for simple systems, and (along with additivity of the entropy) has far reaching 
implications. See, for example. 



3.2 Statistical mechanical derivation 



We give a statistical mechanical derivation of ( p.3|) . We stress that what follows is an 
almost trivial and natural modification of the argument in 0. 

We treat a model similar to Section |] with suitable modifications necessary to represent 
compound systems. 

We again model an adiabatic operation by a time dependent Hamiltonian H{t) with 
t in the range tinit < ^ < ^fin- We denote the initial Hamiltonian as if (tinit) = H and the 
final Hamiltonian as H{tf[n) = H' . 

We decompose the Hilbert space Ti of the system as 

n 

n = (S)nk, (3.4) 

k=l 

and assume that the initial Hamiltonian has the form 

n 
// = ^ ll ® I2 ® • • ■ ® lfc_l 0Hk® Ifc+l ® • ■ ■ ® In, (3.5) 

fc=l 



^ This is not true at tricritical points, but we do not go into such details here. 

^ The entropy principle states, in addition to the law of entropy increase, that the adiabatic operation 



(3.2) is always possible when (|3.3|) holds (and when the conservations of masses are satisfied). We do not 



discuss this additional part of the principle, and focus only on the law of entropy increase. 



where 1^ is the identity operator on Tik^ and H^ acts only on Tik- For each A; = 1, . . . , n, 
we denote by \lp\ ') with i = 1, . . . ,dk = dim(Hfc) the normahzed eigenstate of Hk with 
the eigenvalue El . To represent states of the whole system, we use a multi-index i = 
(ii, Z2, • • • , in) with ifc = 1, . . . , (ifc, and define 



l<^i) = (g)|<0- (3.6) 

fc=i 

Similarly we decompose the same Hilbert space as 

m 

n = (^n[, (3.7) 



and assume that the final Hamiltonian has the form 

m 



i/' = ^ I'l ® 1^ ® ■ ■ ■ ® i^_i ® i/; ® i;+i ® ■ ■ ■ ® i;,, (3.8) 

where 1^ is the identity operator on H'^, and ilf^ acts only on H'^. For each i = 1, . . . , m, 
we denote by \(pj ) with j = 1, . . . , rf^ = dim(7i^) the normahzed eigenstate of H'^^ with 

the eigenvalue Ej ' . We again use a multi- index j = (ji, J2, • • • , jm) with J£ = 1, . . . , (i^, 
and define 

m 

e=i 
We assume that at t = tinit the A;-th simple system is in the Gibbs state with inverse 
temperature (3k- The whole state is then represented by the density matrix 

where Zt(/3) = E?iiC-'"'™. 

Then the system evolves according to the time dependent Hamiltonian H{t) until 
t = tfin- We assume that, near the end of the operation, H{t) stays at H' for sufficiently 
long time so that each of the m simple systems reach equilibrium. (Note that they are not 
necessarily described by the exact Gibbs states. See, for example, the discussion at the 
end of 10.) We denote by U the time evolution unitary operator for the whole process. 



and denote by 

(■••),„,, = Tr[(.->i„it], (3.11) 

the expectation at t = tinit, and by 



(•■■)fin = Tr[(---)t/pinitf/-'], (3.12) 



the expectation at t = tgn. 
Following ( p.4|) , we define 



Pia={fi "''''l?fp \m\um\^ (3-13) 



^k=l 



Zk{/3k 



and 

-(1) TT^W 77^'(1) 77^'M 



/(Ed), . . . , £;W, E'W, . . . , E'M) = ^p,. /(4^\ . . . , E^\E]^\ . . . , 4r )• (3.14) 
Then one easily finds for any (3i, . . . , (3^ tliat 



fc=l £=1 \fc=l ^'^l/^'^V ij \^=i / 

nr=i ^;(A) 



(3.15) 



7'{^) 



wfiere Z'(P) = J2jLi e~ ^ . By using tlie Jensen inequality, we have 



n7=i z'liPi 



exp[E /?.^(^) - E PeE'(^^] < ;» y7v (3.16) 

fc=l £=1 llfc=l^fclPfcJ 



Noting thatQ 
we finally get 



{Hk),^-, = E(>^), {H',),^ = E'(^), (3.17) 



E ^k{{H,)init - Fkm} < T.Pd{H',K - Fm}. (3.18) 

k=l 1=1 



for any /3i, . . . ,/^^, where Ffc(/3) = -(3-^ log Zk{l3) and F;(/5) = -/3-MogZ;(/3). Then the 
desired inequality 

n m 

T.Sk<T.Se, (3.19) 

k=l 1=1 

follows (for a macroscopic system) as in Section p.3| 

3.3 Remarks 

It is quite remarkable that Jarzynski's method provides us with such a simple (indeed 
almost trivial) proof of the strongest form of the law of entropy principle. 

It should be noted, however, that the present derivation works only when the initial 
state is a product of exact Gibbs states. The heart of modern statistical physics is that 
macroscopic system in equilibrium can be modelled by various different distributions, and 
all of them give rise to the same (true) thermodynamics. According to this spirit, we must 
be able to extend the present derivation to a much wider class of initial states, but it seems 
rather difficult for the moment. Note that for simple systems, there exists a proof of the 
second law of thermodynamics which works for a large class of distributions |T^, but the 
argument there can hardly be applied to compound systems. 
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To be precise, the left-hand side should be (li ® ■ ■ ■ ® Ife-i ® Hk ® Ife+i ® ■ ■ ■ ® In) 



4 Heat transfer between two quantum systems 

We briefly discuss preliminary results obtained by applying the present techniques to a 
highly nonequilibrium transient phenomenon. More precisely, we put two quantum system 
in different temperatures into a thermal contact, and wish to examine the heat flow from 
one system to the other. This is essentially contained in Jarzynski's work |0, but our 
motivation here seems less ambitious. 

Consider a quantum mechanical system consisting of two systems whose Hilbert spaces 
are Hi and 7^2- Then the Hilbert space for the whole system is 7i = 7f i ® H2. We assume 
that the Hamiltonian of the model is time independent, and write it in the form 

H = Hi®l2 + li®H2 + Hi^t, (4.1) 

where Hk acts only on Hk {k = 1,2) while ifint acts on the whole H. For k = 1,2, 
we denote by \(pl ) the normalized eigenstate of Hk with the eigenvalue E^ where i = 
1,. . .,4 = dim(Hk). 

We assume that initially (which corresponds to t = 0) two systems are independently 
in equilibrium at inverse temperatures (3i and (32, respectively. This corresponds to the 
density matrix 

with Zk[(3) = J2iti e~^^i . Then the expectation at time t is given by 

(■■■), = Tr[(---)^(t)A„it^(-t)], (4.3) 

where the unitary operator for time evolution is U{t) = e"*-'^*. 

In order to test for the possible heat transfer between the two systems, we examine 
the quantity^ 

ASit) = A{(//i), - (ifi)o} + P2{{H2), - {H2),}. (4.4) 

Since {Hk)^ — (-f^fc)o is the increase of energy in the k-th system, AS{t) can be interpreted 
as the increase of entropy in the whole system, provided that the change in the inverse 
temperatures of the two systems are small and the contribution of i^int to the total entropy 
is negligible. 

To examine AS{t), we again introduce the probability 

P^,r,Ut) = V77TTV7^K^^^Kv^?V(t)|^r^)bf )r, (4.5) 



ZiiPi) Z2if3: 



'2 



and the corresponding classical average of a function f(E^^\ E^'^\ E'^^\ E'^"^^) as 

[/(i?«,i?(2),i?'«,i?'(^))],= Y. P.,r,Ut)f{Ei'\Ef,Er\Ei\ (4.6) 

i,j,£,m 



^^ To be precise, Hi and H2 should be ifi(g)l2 and li(g)iJ2, respectively. We make the same abbreviation 
in what follows. 



where we avoided the notation / since the average depends on t. Note again that 

[E^% = {H,),, [E'^% = {H,),. (4.7) 

Now it is automatic to check that 

9i(£;(i)-£'(i))+/32(£(2)_£;/(2))l ^ ^ ,^ g- 

for any t. Then the Jensen inequahty [e-^]t > et-^1' imphes 

AS{t) > 0, (4.9) 

which shows the (wellknown) fact that heat never flows from the colder to the hotter. 
We stress that (|4.9|) has been proved rigorously (and indeed very easily) for quite general 
quantum systems. 

To get a stronger result, let s = (3i{E'^'^^ - E^'^^) + /32(^'^^^ - E^'^'^). Then [s]t = AS{t). 
Since (|0|) says [e^% = 1, one has 



ASit) = [s]t = [e-^ -l + s]t = [dis)]t, (4.10) 

where 

d{x) = e-''-l + x = Y.^--^ (4.11) 



„=2 ^'■ 



satisfies d{0) = and d{x) > for any x ^ 0. (^4.10|) and ( |4.6|) lead to the expression 



A5(t) = E p,,,Ut) dmE}'^ - E^'^) + P,{Ei'^ - Ef )], (4.12) 

i,j,£,m 

which is remarkable in that every term in the sum is nonnegative. This means that, when 
one tries to construct a rigorous lower bound for AS{t) (which would rigorously establish 



the existence of a finite heat flow), one can freely throw away unwanted terms in ( 4.12 
only keeping well controlled terms in the sum. (Moreover d{x) can be bounded from 
below by simpler functions if necessary.) Although we have no concrete estimates in this 
abstract setting, we hope one can construct meaningful rigorous lower bounds for AS{t) 
by examining typical concrete models. 

Let us make one more remark in connection with the fluctuation theorem. If we define 

Ptis) = E P^.,Ut) xmE'P - Ei'^) + f32iE'^^ - Ef) = s]. (4.13) 

i,j,i,m 



Then exactly as in Section |2.4| , we can prove 

e-'Pt{s) = P^t{-s), (4.14) 

or, for models with time reversal symmetry^ 

e-'Ptis) = Pt{-s), (4.15) 

12 In the sense that \{ip'm^\U'^\U{t)\ip[''^)\^f)\ = \{ip'^^\W^\U{-t)\ip['^)\ipf)\ for any i,j,e.m. See 
footnote ^. 
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which has the form of "fluctuation theorem." This is a special case of Jarzynski's "detailed 
fluctuation theorem" [Q. 



It is a pleasure to thank Shin-ichi Sasa for introducing me to the whole subject, and 
for indispensable discussions. 
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